ADAPTIVE FILTER FOR COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention.- This invention relates to adaptive systems in the areas of 
communications and control, particularly to a real computation solver for systems of linear 
equations with complex-valued elements. 

(2) Brief Description of Related Art- Adaptive filtering is widely used in communication 
systems to optimize the reception of signals. A sample of such a system was described in a paper 
by A. Klein and P.W. Baier, "Linear unbiased data estimation in mobile radio systems applying 
CDMA" IEEE Journal on Selected Areas in communications, vol. 1 1 , pp. 1058-1066, 1993 . In the 
areas of adaptive filtering, parameter estimation and system identification, linear prediction 
provides the means for adapting linear systems to a set of measurements or observations. The 
parameters required to perform this adaptation are extracted by solving overdetermined systems 
of linear equations of the desired system adaptation parameters, the elements of which are usually 
complex-valued. In general, a system of linear equations can be represented by the equation 

Xa=d, (1) 
where the measurements or observations are arranged in the matrix X of dimensions NxM, the 
vector d of length N contains a known or estimated sequence and a is the vector of length M with 
the desired system adaptation parameters. Among the possible methods for solving such systems 
of linear equations, the solution in the least squares sense , termed as Least Squares Solver 
(LESS) from now on, is the most widely used. Special cases of LESS are the well-known Least 
Mean Squares (LMS) as described by S. Haykin m Adaptive Filter Theory, Prentice Hall, 2 nd Ed., 
pp.67-68, 1994, Recursive Least Squares (RLS) as described by E. Frantzeskakis and KJ.RLiu, 
in "A Class of Square Root and Division Free Algorithms and Architectures for QRD-Based 
Adaptive Signal Processing", IEEE Trans. On Signal Processing, volt,42, no.9, pp. 2455-2469, 
Sept. 1994, and the Householder algorithms as described by K.J.R, S.F. Hsien and K. Yao in 
"Systolic Block Householder Transformation for RLS Algorithm with Two-Level Pipelined 
Implementation", IEEE Trans. On Signal Processing, Vol.40, No.4, pp.946-958, April 1980. 

However, the application of LESS is computationally complex. It is desirable to reduce the 
computational complexity without sacrificing performance, stability or convergence rate. 
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SUMMARY OF THE INVENTION 

An object of this invention is to reduce the complexity in implementing an adaptive filter. 
Another object of this invention is to reduce the computational complexity without sacrificing 
performance, stability and convergence. 

These objects are achieved by a three step method for applying a LESS that enables a 
significant reduction of the computational complexity. In a first step, this method uses Lee's 
transformation , denoted herein as linear binary orthogonalization transformation (BOT), from 
complex number arithmetic to real number arithmetic. In a second step, two real computation 
LESS are applied. In a third step, an inverse BOT (IBOT) from real number arithmetic to 
complex number arithmetic is introduced. The IBOT is the counterpart of Lee's BOT and its 
output provides the desired complex-valued system adaptation parameters. Concerning the first 
step of the method, i.e. the introduction of the BOT, two types of BOT are proposed: The first 
one relies on Lee's transformation as described in A.Lee, "Centrohermitian and skew- 
centroheritian matices", Linear Algebra and its Applications, volt 29, pp.205-210, 1980 and 
maps a complex-valued matrix of dimensions NxM onto two real-valued matrices, each of 
dimensions NxM. The second type of the BOT produces from a complex-valued matrix of 
dimensions NxM two real-valued matrices, each of dimensions NxM, by adding and subtracting 
the real and imaginary parts of the complex-valued matrix, respectively. Concerning the third step 
of the method, i.e. the introduction of the IBOT, two types of IBOT are proposed: The first one 
is the counterpart of the first type of the BOT presented above, while the second type of the 
IBOT is the counterpart of the second type of the BOT presented above. 

Compared to the known method, i.e. the application of a complex computation LESS, the 
proposed technique achieves a significant reduction of the computational complexity without 
sacrificing performance, stability or convergence rate. Therefore, this technique is particularly 
appropriate for implementation of adaptive systems on programmable machines, as well as 
dedicated VLSI architectures in the areas of communications and automation control. 

The innovations of this invention are: 

1 . Introduction of the IBOT that is the counterpart of the BOT relying on Lee's 
transformation. 
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2. Introduction of the BOT produced by adding and subtracting the real and imaginary parts 
of the complex-valued measurements or observations. 

3 . Introduction of the IBOT that is the counterpart of the BOT produced by adding and 
subtracting the real and imaginary parts of the complex-valued measurements or 
observations. 

4. Combination of BOT with IBOT and real computation LESS in order to implement a 
complex computation LESS. 

5. Application of two LESS in parallel or serially. 

6. Application of these methods for temporal or spatial or joint temporal and spatial channel 
estimation or equalization, for carrier frequency estimation, for Direction Of Arrival 
(DO A) estimation or for joint carrier frequency and DOA estimation. 

The advantages of this invention are: 

1 . Reducing the number of operations required for applying a LESS on a programmable 
machine like a Digital Signal Processor (DSP) by up to 50 %. 

2. Reducing the circuit area required for implementing a LESS on VLSI architectures by up 
to 25%. 

3 . Enabling the application of a larger size LESS with the available resources, resulting in a 
broadening of the range a LESS can be applied to. 

4. When applying the BOT that relies on Lee's transformation, the accuracy of the desired 
system adaptation parameter estimate is increased due to the inherent forward-backward 
averaging (FBA) feature of this type of BOT. 

Note: The dynamic ranges of the algorithm variables and the convergence characteristics are 
the same with the original complex-valued LESS. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig 1 shows the Prior art: Serial complex computation LESS 

Fig.2 shows a Parallel real computation LESS according to the invention 

Fig, 3A shows the structure of the first type BOT building block 

Fig.3B shows an alternative structure of the first type BOT building block 

Fig.3C shows a structure of the first type BOT 

Fig.3D shows a structure of the first type IBOT building block 
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Fig.3E shows an alternative structure of the first type IBOT building block 

Fig.3F shows a structure of the first type IBOT 

Fig.4A shows structure of the second type BOT 

Fig.4B shows a structure of the second type IBOT 

Fig. 5 shows a serial real computation LESS according to the invention 

Fig.6 shows a parallel real computation Constrained LESS (CLESS) according to the 

invention 

DETAILED DESCRPTION OF THE INVENTION 
Prior art:- 

Fig. 1 illustrates the prior art in applying a LESS where all computations take place in 
complex number arithmetic. More specifically, the complex-valued input vector x of length M is 
p fed to block 100 representing the serial complex computation LESS that produces at its output 
*pi the complex-valued parameter vector a of length M. In the areas of communications and 
"f* automation control, there might be a need for the recursive updating of the output parameter 
SI vector a depending on a sequence of input vectors x, i.e. there might be a need for adaptive linear 
j* prediction. In this case, block 100 in Fig. 1 represents a LESS of the recursive type like the RLS 
L algorithm or the LMS algorithm and variations thereof, e.g., computation of the RLS algorithm 
^ by a systolic array or the use of the Householder transformation, the Cholesky decomposition, the 
m Singular Value Decomposition (SVD) as described by S.L. Marple, Jr., in Digital spectral 
[7 analysis with applications, Prentice-Hall, Englewood, New Jersey, 1987, or the QR 

Decomposition (QRD). However, there are also cases where the output parameter vector a is 
produced from the input vector x in a non-recursive or blockwise fashion. This situation can be 
described by the direct multiplication of the input vector x with a matrix A, both with the 
appropriate dimensions, and is typical for channel estimation and channel equalization in the areas 
of communications and automation control, see [6] for a representative work. In this case, block 
100 in Fig. 1 represents a LESS of the non-recursive or block type, e.g., the Block Matched Filter 
Estimator (BMFE) or the Block Zero Forcing Estimator (BZFE) or the Block Minimum Mean 
Squared Error Estimator (BMMSEE). Summarizing, block 100 in Fig. 1 represents a serial 
complex computation LESS of the recursive or the block type. 
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Description / Derivations:- 

1 . Parallel Real Computation LESS (Fig. 2): Our objective is to apply a LESS of the 
recursive or the block type by using real number arithmetic throughout, except for an initial BOT 
from complex number arithmetic to real number arithmetic and a final IBOT from real number 
arithmetic to complex number arithmetic. Fig. 2 illustrates the proposed architecture termed 
parallel real computation LESS 200. At first, the BOT 210 is applied to the complex-valued input 
vector x and produces two real-valued output vectors yAand y B . The details of the BOT 210 are 
described in the following Section 2 for the first type and in Section.3 for the second type of the 
proposed transformations. Then, each one of the real-valued vectors y A and y B is fed to block 220 
representing a LESS, the computations of which exclusively take place in real number arithmetic. 
Note that the two LESS operate in a parallel fashion. Each LESS produces a real-valued output 
vector denoted as b A and 1>b ? respectively. Then, an IBOT 230 is jointly applied to b A and bs so 
that the output vector a gives an equivalent result to the output of the serial complex computation 
LESS 100 illustrated in Fig. 1. The details of the IBOT 230 are described in the following Section 
2 for the first type and in the following Section 3 for the second type of the proposed 
transformations. 

2. BOT and IBOT of the first type (Fig. 3): In this paragraph the details of the BOT 210 and 
the IBOT 230 of Fig. 2 are explained when the first type of the proposed transformations is used. 
Consider a complex-valued input vector x of length M, with M being a positive integer. In the 
general case where M is odd, i.e. M equals 2k+l with k a non-negative integer, x may be written 
as 

* = kx e slF> ( 2 ) 
where xi and x 2 , both of length k, represent the upper and lower part of x and Xc represents the 
central element of x. Certainly, when M is even, the central element ^ should be dropped. Then, 
according to Lee's transformation [2], setting out from x two real-valued vectors y A and y B each 
of length k are produced, the structure of which is in one-to-one correspondence with the 
structure of x, see (2), i.e. 



y A ^Ly^yl^F and y B ^^y^y^F- 



(3) 



The BOT is algebraically expressed by the equations 

y A = [Rejsf +X ; T n k } V2Re{ XA J Imfc T + *; T n k f (4) 

y B - [jm^J -x; T n k } - Slm{xJ Re{*[ -x?II k ff , (5) 

where Re{} and Im{} denote the real and imaginary part of their complex argument - a complex- 
valued vector or a complex number - and Il k denotes the kxk exchange matrix having ones on 
its antidiagonal and zeros elsewhere. According to (4) and (5), each element of the real-valued 
output vectors y^i, Yb,i 9 and y B ,2 is produced from additions of two elements of the vectors 
xi and x 2? see (2). This operation is implemented by BOTA 310 shown in Fig. 3 A, where the 
blocks 350 and 355 apply the operators Re{} and Im{} respectively, block 365 represents the 
sign inversion operation and block S 360 stands for the addition operation. Furthermore, the 
central elements of the real-valued output vectors yAand ye are directly extracted from the central 
element of the input complex-valued input vector x. This operation is implemented by BOTB 320 
shown in Fig. 3B, where blocks 350 and 355 apply the operators Re{} and Im{} respectively, 
block 365 represents the sign inversion operation and block 370 is a multiplier with the constant 
quantity V2 . The application of the first type BOT 21 1 to the total complex-valued input vector 
x is illustrated in Fig. 3C, where the blocks BOTA 3 10 and BOTB 320 are shown in Fig. 3 A and 
Fig. 3B, respectively. 

The counterpart IBOT of the first type BOT is introduced in the following. Let b A and bs 
express two real- valued vectors of length M. According to Fig. 2, these vectors represent the 
output of the two parallel real LESS of the proposed architecture. b A and bB are partitioned 
according to vectors y A and y B produced by the first type BOT, i.e. 

b^k^Xzf and b^^b^b^f. (6) 
If the desired complex-valued output parameter vector a, see Fig. 1, is partitioned as 

then the first type IBOT is algebraically expressed by the equations 

a, = (W2)[b A>1 +b Bs2 +j(b Aj2 -b B ,)] (8) 

a 2 =(1/V2) n k [b A , -b B , 2 -j(b A>2 + b w )] (9) 
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(10) 



where j denotes the imaginary unit. According to (8) and (9), each element of the real part and the 
imaginary part of the complex-valued vectors ai and a 2 , see (7), are produced by additions of the 
elements of the vectors bA,b , b B ,i and b B2 and multiplications with the constant quantity 
1/ V2 . This operation is implemented by DBOTA 330 shown in Fig. 3D, where block 365 
represents sign inversion, block S 360 stands for addition and block 380 expresses the 

multiplication with the constant quantity 1/^2. Blocks 385 and 390 represent the creation of a 
complex quantity from its real and imaginary part. Furthermore, the central element ac of the 
complex-valued output vector a is directly extracted from the central elements b^c and b B ,c of the 
real-valued input vectors 5a and be. This operation is implemented by IBOTB 340 shown in Fig. 
3E, where blocks 365, 385 and 390 are described above. The first type IBOT 232 producing the 
total complex-valued output vector a is illustrated in Fig. 3F, where blocks IBOTA 330 and 
IBOTB 340 are shown in Fig. 3D and Fig. 3E, respectively. 

3. BOTandlBOTofthe second type (Fig. 4): In this paragraph the details of the BOT 210 
and the IBOT 230 of Fig. 2 are explained when the second type of the proposed transformations 
is used. Consider a complex-valued input vector x of length M, with M being a positive integer. 
Then, two real-valued vectors yAand y B each of length k can be produced from x by adding and 
subtracting the real and imaginary parts of the complex-valued vector x, respectively. This 
operation is algebraically expressed by the equations 



and its implementation is shown in Fig. 4 A (BOT 212), where blocks 350 and 355 apply the 
operators Re{} and Im{} respectively, block 365 represents the sign inversion operation and 
block S 360 stands for the addition operation. 

The counterpart IBOT of the second type BOT is introduced in the following. Let b A and b B 
express the two real-valued vectors of length M representing the output of the two parallel real 
LESS of the proposed architecture (see Fig. 2). Then, the IBOT of the second type is 
algebraically described by the equation 



y A =Re{x}+Im{x} 
y B = Re{x}-Im{x}, 



(11) 



(12) 



a 



=(b A +b B )+j(b A -b B ) 



(13) 
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where a is the desired complex valued output parameter vector. This operation is implemented as 
shown in Fig. 4B (IBOT 232), where block S 360 stands for addition, block 365 expresses sign 
inversion and blocks 385 and 390 represent the creation of a complex quantity from its real and 
imaginary part. 

4. Serial Real Computation LESS (Fig. 5): In numerous communication applications 
periodic or non-periodic training data is used to assist the adaptation process of LESS. This input 
data is fed in bursts of, e.g., length N. Consequently, instead of using two real computation LESS 
in parallel (see Fig. 2), we can adopt a serial architecture employing a single real computation 
LESS. This serial architecture is illustrated in Fig. 5 and is labeled as Serial Real Computation 
LESS 400. After processing the data in BOT 210, the real computation LESS in block 220 is 
serially fed by the vectors y A and y B . In order to enable this serial usage of block 220, the 
combination of a buffer 410 and a Switching Circuit 1 (SW1) 420 is introduced. The buffer 410 
stores a sequence of vectors y B of length N. During this time period, the switch of SW1 420 is in 
the upper position. At the same time, the output vector b A is stored in a buffer 440 with the switch 
of Switching Circuit 2 (SW2) 430 being in the upper position. After the sequence of vectors y A is 
fed to the real computation LESS 220, the switch of SW1 420 is moved to the lower position and 
the sequence of vectors y B is fed to block 220, while the switch of SW2 430 is moved to the lower 
position. The vectors b A and bs are simultaneously fed to the IBOT 230, exactly as in Fig. 2. The 
output of the IBOT is the desired complex-valued parameter vector a. Compared to Fig. 2, the 
proposed method in Fig. 4 leads to more cost-effective implementations on DSPs and VLSI 
architectures, since the LESS 220 is a highly demanding part of the system in terms of 
computational complexity and required circuit area. The only penalty in this architecture is a 
processing latency of N input clock cycles. 

5. Parallel Real Computation Constrained LESS (Fig. 6): There are cases in 
communications and automation control where a LESS is applied more than one time, say P 
times, subject to P different constraints. In these cases, from a single observation vector x, P 
different parameter vectors a 00 , p=l . . .P, are produced. A Constrained LESS (CLESS) usually 
operates with complex number arithmetic. In Fig. 6 we show how our method is extended for 
computing CLESS by using real number arithmetic throughout, except for an initial BOT 210 
from complex number arithmetic to real number arithmetic and P final IBOT 230 blocks from real 
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number arithmetic to complex number arithmetic. At the output of each real LESS 220 in Fig. 6 P 
real-valued vectors and b^ } , p=l . . P, are produced and are fed to a bank of P IBOT 230 
modules. At the output of each IBOT a specific output parameter vector a (p) , p=L . .P, is 
delivered. 

While the particular embodiment of the invention has been described, it will be apparent to 
those skilled in the art that various modifications may be made in the embodiment without 
departing from the spirit of the present invention. Such modifications are all within the scope of 
this invention. 
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